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Abstract 

We prove that a large set of long memory (LM) processes (including classical LM processes and all 
processes whose spectral densities have a countable number of singularities controlled by exponential 
functions) are obtained by an aggregation procedure involving short memory (SM) processes whose 
spectral densities are infinitely differentiable (C°°). We show that the C°° class of spectral densities 
is the optimal class to get a general result for disaggregation of LM processes in SM processes, in 
the sense that the result given in C°° class cannot be improved taking for instance analytic functions 
instead of indefinitely derivable functions. 
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1 Introduction 

LM processes, are used in many fields such as economics, finance, hydrology or communication 
networks. Let 7 be the covariance function of the process and 

ll7llsM = X>(fc)|. 

If UtIIsa/ < 00 then we say that the process is SM and if ||7||sm = 00, we say that the process is LM. 
The long memory is generally associated to the singularities of the spectral density /. 



1 



2 



D. Dacunha-Castelle and L. Fermm 



Some of these LM processes can be seen as an aggregation, that is a normalized sum of elementary 
SM processes, see |il 151 171 151 HQ). 

All important examples of LM in finance, hydrology or communication networks etc. are obtained 
by a model of aggregation, perhaps more complicated that the model used here. Our result says that 
one has almost always the possibility to think the LM macroprocess as an aggregation of elementary 
processes with C°° spectral density. 

The procedure of aggregation can be developed considering doubly random elementary processes 
Z % — {Zl(Y l ), t £ T} centered second order and stationary, where Y = {Y l , i £ N} is a sequence of 
i.i.d. random variables with distribution /j, on R s ; T = Z in the case of discrete processes and T = R 
in the continuous case, see 0. 

For every fixed trajectory of Y, we define the sequence of partial aggregations X N = {X^ (Y), t £ 
T}, of elementary processes {Z 1 }, by 

1 N 

xf(y) = ^-^zi(y i ) J (i) 

I— 1 

where Bn is a normalization sequence of positive numbers. Under some general conditions, for almost 
every trajectory Y, X N converges in distribution to the same Gaussian process X, which is called 
the aggregation of the elementary processes {Z 1 }. 

Equivalently, the aggregation procedure can be also developed using mixtures of spectral densities 
as main tool. Let g(X,y), X £ I, y £ R s , be a spectral densities family, where I = (— n,n] in the case 
of discrete processes and / = R in the continuous case. We consider, for Y l = y fixed, that g(\, y) is 
the spectral density of the elementary process Z l (Y l ). Let fi be a probability on R s , the /i-mixture 
of the spectral densities g(X,y), is defined by 

/(A)= / g(\,y)dfi(y). (2) 

/(A) is a well defined spectral density iff 

f(X)d\ < co. (3) 

The sequences of processes {X , N £ N}, defined in Q, is now the partial aggregation sequence 
of the elementary processes {Z 1 } associated to the mixture /(A). 
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Under condition J^J in 2 it is shown that if the elementary processes are independent then 
the aggregation exists [i — a.s. and its spectral density function is /(A). Futhermore, the case of non 
independent elementary processes is studied considering an interactive correlation between elementary 
processes. 

Disaggregation is the inverse procedure of aggregation. Let G be a class of spectral densities and 
let M(&) denote the set of mixtures of spectral densities belonging to G. We say that a process with 
spectral density /(A) can be disaggregated into elementary processes with spectral densities in G iff 
/ G M(G); equivalently by disaggregation in G, we mean the existence of a representation of a given 
process as an aggregation of elementary processes belonging to G. The disaggregation problem is 
then equivalent to the following question: When do we have / G A4(G) for / and G given? In this 
work, we consider the procedure of aggregation only for independent elementary processes. A known 
example is the disaggregation of the FARIMA(d) process on G = AR(1) the class of autoregressive 
processes of order 1, see (HI- A more general development of the disaggregation in the class of AR(p) 
processes is given in |3] where we also show results of disaggregation, for continuous processes, in the 
class of p-order Orsteins-Uhlembeck processes, OU(p). 

Our purpose is to study the disaggregation procedure in SM processes and on subclasses G for 
which the covariances decrease as fast as possible. We prove that a large set of LM processes, whose 
spectral densities have singularities of different kinds, are obtained by an aggregation procedure 
involving processes whose spectral densities are infinitely differentiable. There is no unicity for this 
procedure. Classical LM processes are included in this set. 

Conditions for the existence of a disaggregation on AR(p), OU(p) classes or on A, set of analytical 
spectral densities, are very restrictive. They are related, as in the AR(1) case, to specific algebraic 
properties of /, for instance to be a Mellin transform, and the elementary processes have a spectral 
density roughly of the form &(yf(\)) where the regularity of $ is sufficient in order to destroy the 
singularity of /. 

We show that the class C°° of indefinitely differentiable spectral densities is the right class to get 
a general result for disaggregation of LM processes in SM processes. For / G C°°, the respective 
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covariance function decreases faster than n -J for any j. This decay can measure the level of SM 
comparatively to that of A which is exponential. Disaggregation on C°° is linked to very weak 
analytical properties much easier to satisfy by / than the algebraic properties required by analytic 
disaggregation and the elementary densities are here roughly of the form g(X, y) — f(X)K(X, y), where 
if is a kernel such that at each singularity Ao of / we have f(Xo)K(Xo,y) = as well as for all its 
derivatives. The C°° behavior of K drives the C°° behavior of g(X, y). Then we show examples of C°° 
functions that can not be disaggregated on the class A. On the other hand, for very rough densities, 
we give examples of LM processes which cannot be the aggregation of short memory processes. We 
shall call such a situation as "hard" long memory. This result is a good illustration of "how much 
singularity have to be concentrated" in order to generate LM by aggregation. 



2 Condition for the Existence of Disaggregation in SM 

Let us begin with some remarks about mixtures and LM property giving rough necessary conditions 
for existence of a disaggregation on SM densities. We use only the fact that every SM density is 
continuous, (in fact sufficient conditions for SM property are for instance to be a-lipchitzian for every 
a, < a < 1, or to be a-lipchitzian for some ct > i and of bounded variation). 

Lemma 1. A spectral density is a mixture of continuous spectral densities iff it is lower semicontin- 
uous (l.s.c). 

Proof. If / is such a mixture, applying Fatou's lemma we see that it is l.s.c. Conversely, if / is l.s.c. 
and positive, it exists, a sequence g n of continuous functions such that / = sup n <; n . Taking the 
supremum until n we can choose g n increasing. So / = J2 n >i 2 -n (2 n (c?n+i — g n )) which is of the 
form J gd/j,. □ 

From the lemma, we see that every non l.s.c. spectral density has LM property and cannot be 
disaggregated on SM class. For instance, if h is the function equal to one on a perfect set, 0, of 
strictly positive Lebesgue measure, then h is upper semicontinuous (u.s.c.) but non l.s.c. and it is the 
density of a absolutely continuous probability with respect to the Lebesgue measure. This provides 
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an example of a situation that we can call "hard" LM process which cannot be disaggregated by SM 
processes. In fact, we are very closed to the case of a non absolutely continuous spectral measure. 



Long memory of a process with spectral density / is in general associated to singularities of / or of 
some of its derivatives at a frequency Ao. Singularities are often classified as a first order when one 
side limit exists and second order singularity when the function tends to oo as A tends to Ao or it 
does not exist any limit at Ao (the function being bounded or not, with bounded variation or not). 
We try to take into account most of these situations. Our main purpose is to obtain for a class as 
broad as possible, including all classical examples but not limited to more or less explicit densities, a 
disaggregation on elementary processes with the best possible decay of correlations. We are lead to 
work mainly with G = C°° (resp. C H ) the class of all spectral densities belonging to C°° (resp. C H ); 
an equivalent property is that the correlation function of / € C°° tend to faster than l/n J for any 
j 6 N (resp. faster than c/n H for some c > 0). For H, 1 < H < oo, given we get for a function 
/ 6 C H except for a finite or countable set of frequencies, a disaggregation on a C H class. It seems 
that disaggregation on the class C°° is easier to reach than a disaggregation on the SM class. 

In order to extend the qualitative situation analyzed for the case G = AR(I), in we introduce 
the following definition. 

Definition 1. Let A C / be a finite set of frequencies, we define as the set of spectral densities 
in C H , 1 < H < oo, which are on A as all their H derivatives. If A = {0} we denote by Fq . 

Let now K be a positive kernel, for instance on R + , so K(y)dy — 1 and let (J be a positive 
function on /. We use the trivial relation 



where g(\,y) = f(X)cf>(X)K(4>(X)y). 

The pair [K; <j>] will be called a killer kernel (it kills the singularities). The generic situation is 
given by the formula f(0)</>(0)K(<j>(0)y) = lim^o f(\)(t>(\)K ((t>(X)y) = for every y € R + , even if 
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/(O) = oo. So f is the dy mixture of g(X,y) G F^ 1 . We can extend the definition of mixtures of 
spectral densities, given in 0, taking for /i a non bounded measure, as the Lebesgue measure dy, 
in this case we can consider that we take a strictly positive density of probability cr(y) and then we 
consider the mixtures of a" 1 (y)g(X,y) by the probability a(y)dy. 

Let us give some examples of disaggregation of a function / with a single singularity at Ao- We 
consider the standard situation where / and its derivatives are explicitly controlled by exponential 
finctions. The key to solve our problem is the representation of / given in 

Example 1. Let /(A) = 1 ( _a ,a )(A) for A G I, 0(A) = l/\X 2 -X%\ p with < p < 1, and K(y) = e~ v . 
In this case is easy to check that g(X,y) G -Fr^-Ao a o}' smce au derivatives of g are for |A| = Ao. 
Example 2. Let /(A) = |1 - cos(A - A )|" d , < d < 1, A Gl = We keep 0(A) = 1/|A-A | P 

with < p < 1, and K(y) — e~ v . All derivatives of / at A = Ao are controlled by a negative power 
of |A - A | and so g(X,y) G F\ . The same properties can be easily checked for a strongly oscillating 
function / as cos(7r(A — Ao))/|A — Ao| 9 , for < q < 1. So for these kinds of controlled singularities, 
we show that / G M(F^) G M{C°°). 

Definition 2. Let f be a spectral density. We say that f G S H , 1 < H < oo, iff f has a continuous 
H derivative at every frequency except for a finite set of frequencies A = {Aj, j G J} and if it exists 
q, < q < 1, and a, < a < 1, such that for all j £ J and for all I < H 

^{~\x^) l/(i)(A)l = a 

If A is a countable infinite set instead of finite and has only a finite number of accumulation points, 
then we say that f G T H . 

We state now a theorem for the standard situation. 

Theorem 1. Let f G S H , 1<H< oo, then f G M(F^) C M(C H ). 

Proof. Let 0(A) = (j[ j£J |A - A^)"' , K(y) = e"« and g(X,y) = f(X)cb(X)K(4>(X)y). Then /(A) = 
/ °° g(X,y)dy. We choose p such that < q < p < 1. If *(A,y) = 0(X)K(4>(X)y) then for all the 
/-derivatives of g, I < H, we have that it exists constants bi, Ci and mj such that 

\g {l \\y) 



Y^c k>l f^^ l - k \x,y) 



< Ci\^(X,y)\ 



E j£ 
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So g(\,y) G Fj? and / G M(F^) C M(C H ). □ 

Example 3. If /(A) = A|~ d , A £ / = R, < d < 1, / is the spectral density of continuous fractional 
Brownian motion. Then \f (A)| = 0(l/|A| d+! ) and the conditions of Theorem are satisfied. 
Next theorem is an extension of Theorem but using a localization required if A is infinite. 

Theorem 2. Theorem^ remains valid if f G T . 

Proof. Suppose, in order to simplify notations, that A is an infinite countable set with only one 
accumulation point. The general case can be easily obtained by re-indexing of A points using the 
partition of I defined by the points of accumulation of A and then applying the same proof. So we 
can suppose A = {Aj, j > 1}, with Aj < Xj+i for every j G N. 

We build in the same spirit than previously a family of functions g A (X,y), multiplying / by a 
killer kernel [K; cf) A ](X,y) that annihilates the points of discontinuity of /. 

Let us note a = inf I, b = sup I and Aoo = limj^oo Aj = sup^ A_, . Let be p such that < q < p < 1, 
and we consider 

[K,(/>°](\, y) = p^»p(-p^)l<^>(A). 

[ ^ 1(A,y) = |A - Aj|p|A - A j+1 |p 6XP (" |A - A7MA" - WW*)' 



Then we define 



and 



[i,;0 A ](A,y) = £[^](A,y), 

3=0 



g A (X,y) = f(\)[K-A A ](X,y). 



We have that, 

p oo p oo j 

/ [K ;( b A ](X,y)dy = e~*dz h ((liAl) + ^ 1 (A A > + 1 
Jo Jo \ 



(Aoe,i>) 

3>1 



So V(y) = Jj g A (X, y)dX and by applying Fubini's theorem V{y)dy = J } f(X)dX = 70 < 00. 
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We can prove, by using the same proof as for Theorem that the H derivatives with respect to 
A of g (X,y) go to when A — > Xj, since q < p. So g A (X,y) £ . □ 

Remark 1. Killer kernels [K; cp] selected to build only the mixtures are never the best ones, for 
coveriances decay. For instance, we can take exp(— exp(i/)) instead of exp(— y) getting covariances 
decreasing to slightly faster and so on. 

Remark 2. We can define mixtures of Wold regular densities, in the Wold Theorem sense, which 
verify the following condition 

log g(X,y)dX > — oo, n — a.s. (5) 

In this case, we say that the processes with spectral densities g(X,y) are regular. If /(A) is the mixture 
of the densities g(X,y), condition © does not imply that f log f(X)dX > — oo. But if f is regular 
then g(X,y) is regular fi — a.s. by Jensen's inequality. The main point on this topic is that we can 
choose the killer kernel [K; <j>] such that if f is Wold regular then all the elementary processes used in 
the aggregation are also Wold regular. 



J, 



4 Analytic spectral densities 

Let us prove, in a certain sense, that the previous results cannot be improved taking analytic functions 
instead of indefinitely derivable functions. 

Disaggregation is a hierarchical procedure: if / £ M(G) and G C .M(]HI) then / £ A4(M), in fact 
if g(X, y) = / h(X, z)du(y, z) then 

fW = J g( x , y)dKv) = J J [H x , y, z)dv(y, z)]dn{y). 

In general we have G C .M(G) C M(G) with strict inclusion, the closure being taken in L 1 (dA). 
The obvious exception is G = MA(q), the set of q- moving average densities, for which MA(g) = 
M{UA(q)) = M(MA(q)). 

We use this hierarchical procedure in order to show that our result can not be improved in the 
following sense: we cannot take analytic functions instead of C°° . So we have to check that the 
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functions we have used in C°°, as /(A) = exp( — pjjp), do not belong to A^(^4), in order to show 
that our result can not be improved. 

Let / G Cg? + where C™+ = {f ■ / > 0, / G C°° , it exists A such that f U) (A ) = for every j G N j . 
Suppose /(A) = J" RS g(\,y)dfj,(y) with g € A — a.s. The Fatou's Lemma implies 

/ 0) (Ao)> / g U \\o,yW(y), 

and f^\Xo) = implies that, if </^(A , y) > fi — a.s., then g^(Ao, y) = n — a.s. From y(A, y) > 
fi — a.s we get y(A ,y) = /U — a.s. and yW(Ao,y) > pi — a.s., and so g^(Ao,y) = // — a.s and 
y' 2 ^(Ao,y) > \i — a.s. By induction we have that g^(\o,y) = /Li — a.s and /x{y, y(A,y) G »4} = 0. 
We have proved that /(A) £ X(^). 

Disaggregation in the class of analytic functions is a very limited possibility. A slight modification 
of the proof just above shows that spectral densities which are constant or linear or polynomial (of 
given degree) by pieces cannot be in M(A) except if they are themselves elements of A, that is, if 
they are polynomials. 
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